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ABSTRACT v 

Two experiments were completed to determine whether 
providing classroom teachers with feedback would reVgult" in Changes in 
both teacher and student behavior. The first experiment was designed 
to extend the validity rOf an earlier investigation by Hoore et al. 
(197U) through replication with a new teacher populatipn and a larger 
samp;Le of male teachers. The second experiment was designe^l to test n 
whether teaching effectiveness would be increased if appropriate 
fee db^ick involved with generating instructional sequences appropriate 
for individual learnets was given. In the :first experiment; "lieachers 
received feedback related to their ability to control theit teaching 
behavior and their ability to apply a theoretically based rationale 
in the resolution of learner^problems. . The experimental teachers 
demonstrated greater control of tlieir teaching behavior as evidenced 
by the low discrepancy between their ratings of the need for 
.intervention and their satisfaction of that need. Teachers in - 
experiment two received feedback associated with their abilities to 
(1) engage in diagnostic procedures when ^ student incorrectly 
answered a question and (2) utilize appropriate diagnostic sequences 
to resolve the problem. There were significant differences in the 
direction of the. experimental groups indicating that (1) experimental 
teachers engaged in diagnosis more of ten; (2)" they conceptualized and 
employed more appropriate proces^BS for diagnosis; and (3) their 
students correctly answered more previously missed items than did 
participants in the control group. In summary , the study deponstrated 
the importance of conceptually appropriate feedback in bringing about 
changes in teadher behavior. (HB) 
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^ AN EVALUAjlON OF THE EFFECTS OF CONCEPTUALLY ^ • 
APPRbPRIATE FEEDBACfK ON TEACHER. AND STUDENT BEHAVIOR 



In spite, of the\ fact that today there are more *t€f;ach^ers^ licensed 

tOr teach ^than there are available positions ^ the shortag/ of effective 

>V . • : \ ^' ' ' ' r . y,' -^^ \ l ^ 

teachers remaih$ at crises proportions. Thus, for teac*er ediii^ators 

the problem, of developing systems for preparing morjreffective teachers ' 

* . * ' \/ ' ' ' ■ 

xoni^inues tq be a- princijbal concern. 

• • ■ • - ' ' / V . 

One effortjto improve^ the quality of teacher education which has 
received jnust attention in Vecent years has beep the development' of 
ptogj^s referred to'' frequent^ly as Competency Based Teacher Education . . 

programs (CBTE). Generally, the procedure involves ^the careful 

' . ' . « - \ , ^ ^ t /• .... 

specification bf competencies thought to be associated with effective ^ 
teaching and then the design* of •;br|6grams and educational expeTiences ^' 
considered productive in producing those cbmpetencies.^ Ideally, the 
teachers remain in the program' until they^^.'ttemgnsjrate thp previously 
specified competencies. Realistically, p^j^^larf^ at the undergraduate 
level%nhere time to graduate is usually ft^ld coni^tstot, teachers are * ? 
graduated demonstrating varying levels of competence. 

In spite of this limitation) there are a nnmber of important ^ 
'reasons for specif^^ihg competencies as a basis for devef^pirig and 
imp&menting teacher education* programs. One '^reason is' that it increases 

' ■ ■ - • ■' • ■ . • - / 

the probability that teacher education prdgrams are more likely to / 
result in effectiveness models as opposed to the more commonplace j 

.lexpoSure models. Possibly of greater^ importance is the/potential of 
prpviding. |)rosp^ctive teachers with more relevay^ .i5&edfcck, associated ' 

'wi,th training, thus increasing both the^^fectivenfess and the efficient) 



of the-te^lfej?r education procram^. " A 



A number of factors must be^ considered if feedback is -to be most 

/" 0 " / 

effective in the training program. First, if the feedback is to result' 

. ■ ■ ' ■ . ■/'■'• " . ' ' 

in more effective teaching, the feedback must be acceptable to ithe 

teacher. Good, et al (1974) has demonstrated tKkt if teachers '*-are given 

feedback about their behavior (it): Was Effective in changing bdth : 

quantitative and qualitative teacher behavior toward target students" , 

(p. 40S).' Second, for feedback to be effective, it must' be valid. 

Further, it can be argued that the* acceptability of feedback by teachers 

is in part a function of tlrjfi validity of the feedback. This is not to 

suggest that some invalid feedback would not be accepted. Rather, if 

valid feedback results in solutions -to instructional problems^ it would 

be .expeqted, that this would tend to reinforce its use. 

IVhile the notion of CBTE programs is predicted on the assumption 

that valid competencies as a basis for providing valid feedback had 

been specified, there is little evi3ence that efforts to identify valid 

competencies have been particularly productive. In all too many cases 

it would appear that competencies are judged to be acceptable if (a) 

they are measurable and (b) the list of competencies is extensile. The 

result has been the production of long lists of teaching competencies 

often with little ^evidence to indicate that they are significantly 

related to Ranges in learner performance. For example, it is reported 

that Weber College has developed over 250 competencies (Phi Delta 

liappan, TdiA) and th^ Pennsylvania Department of Education has 

compiled a list of 66 "generic teaching competencies"^ (Pennsylvania 

Department of Educationi 1973). / * 

The -problem of validity of m^ny of these long lists of competencies 

•• »'•* • " 

'is examplified in the Pennsylvania list. Moore, et al., (1974) 



specified a number of problems of validity in discussing the. PennSyl- 

• ' '. *" ' ■ \- * 

vania Competency Itst;. , . * " 

First,' tjiere' was a failure to differentiate between 
necessary competencies for effective teaching and desirable 
competencies for students. F6r example, the ability to 
develop a -healthy self-Qoncept i'n childr^nHLs listed in the ^ 

Pennsylvania list as a teacher competency when it is in fact 

* ' ^ ( 

a learner competency, ^ Second, the list fails to differen- • 

tiate between enabling and termiilal. competencies. The 

consequences of failing to differentiate between enabl^j^ 

and terminal compete8(ties are at letSt two in numUerl^ 

Specifically, the assessment of terminal competence 

^assumed the assessment of the interaction of enabling 

•' ■ *^ . 

com|)etencies . Thus, where assessment is limit;ed to 

individual enabling competencies, rather than the as'sess7 
ment of terminal competence, the . criNtical injieractions are 
not evaluated, thus rendering evaluation jj^v^lid . This, 
problem is apparent on almost evejglgp^e of ti^e Pennsyl- 
vania generic teaching competenc 

A third major problem, apparent in the list, and one • 
not unrelated to the previous^ two, is the listing of 
instances of teacher competencies as opposed to cohceptual- 
* izations of teacher cpmpetencies. The consequence of 
•listing instances pf competencies as opposed to conceptual- 
ization of^he competencies should be obvious'. F^irst, one 
is not i44tfely to acquire (quite apart from the inefficiency 
of the effort) ali of the instances of all of the concepts 




- .:_qf teacher competence. 'Second^ and more importantly, trying 
to specify all instances implies that the set of instances 
, is finite, whei\ in reality it is ini^inite. Thus, if one 
assmes that the terminal competencies are conceptual in ^ 
nature, it is both unnecessary as well as impossible to list . 
V^^all tl>e instances of behavior which could be jisj^as means 
of developing the terminal competencies. Rather, by listing 
terminal behaviors, which are conceptual in nature, a 
variety of instances of enabling competencies may ,be used to. 
satisfy these ends. ' . 

Finally, with respect to validity, the question must be raised 
concerning the relation of a stated teachler competency ^.nd- lejamer per- 
formance. Specifically, programs may be developed vhicy\ are effectiw 
in producing teachers with demonstrated competencies 4)ut where there is ^ 
little evidence that the acquired competencies are effective in bringing 
about desired changes in learner behavio^. One of the current, more 
comprehensive efforts to relatg^rteacher behavior to changes in ledrner 
behavior has been made by Brophy and associates at the University of 
T^xas (1974). In those investigations obiserved teacher behaviors such 
as giving cues or asking divergent questions were correlated with 
learner's residual gain scores pn achievement tests. While their 
-investigations do demonstrate that teachers do differ in their abilities 
to change learner behavior, the amount of variance accounted for in the 
correlations of teaching behaA^^ and learner gain scores' has been low. | 

An explanation for the relatively small amount of variance accounted 
for may be that the teaching behavior selected for observs^ti^n may not 
lend itself to a single interpretation or t^at the effectiveness while 
being high for some students miay not be effective with all learnets. 



For example, giving context cues is a teaching behaVior often^correlated 
positively ^with learner performance. It is obvious 1;haf what the ^ 
scorer, or for that matter ,the teacher, defines as a context cue- may or 

. A ■ • 

may not be perceiVed as a cqe. by a givep learner. Further, even' if 




this is' not the case, a cue, in a given situation, m^y not be effective 
in bringing about a desired change in learner behavior. Thus,~if feed- ' 
back associated with a teaching; competence is to be given which will be 

maximally effective in helping the "teacl^er to modify the behavior 6f 

■ \ * ' \ 
any student, it must be o^'a type whicn does^ot lend itself to a 

. •■ . ■ ^ ■ ' ■ ' " ' . 

vari ety of interpretations and which is appropriate for all teaching 



situatioriis. • Thus*, it can be argued that while any given instaiiice^ of 
a conceptuali zation of ar competency may be correlated at a 'very, lo 
level with a learner behavior, conqeptualfy it may correlate perfectly. 
It follows that it is the conceptualization which must be acquired,, 
not the instance. 

suggested then for CBTE programs^, to be maximally effective 
at least two conditions mustvbe satisfied. First, competencies must be 
specified which will provide fejpdback to the teacher in t-raining which 
will be accepted by the teacher; and second, the competencies specified 
as ^ b^is for training^must be appropriate for all instructional^ 

situations and must not be given to multi-interpretations. 

' t> . » I- ' '* 

Support for the hypotheses that the specification of competencies 

' » ^ *f 

which would 'result in feedback of a type Acceptable to teachers and 

• ♦ ■ 

which was conceptually appropriate for all inst^ctipnal conditions, 
was obtained in a controlled experiment completed by Moore, Schaut and 
Fritfzges (1974). In this investigation, they argued that thfe cbmnlon 
approach ^o specifying teaching competencies, of classifying teachers 

'ilk' 

into categories of "eff0!|^B|e" and "ineffective" and then attempting 



to induce similarities and differences in teaching behaviors, would not 

produce corape^ettCies necessary and sufficient for all instructional 

f . . * . '. 

conditions^x They krgued that* "The difficulties with this approach are 
at least- two in number. First, if the sample of teaching behavior ^s 
not completely representative of effective teaching, it is probable* 
that one wiLl induce sonje teaching behaviors which are irrelevant- and 

* • ' y ■ " * 

' «• ... 

treat them as relevant « Second, one may inadvertently classify 
enabling d^petencies,' like thfe'use of feedback, as a terminal 
cdlnpetence/*' Their procedure was to use what they referred, to as a 
rational scientific approach and tfcey suggested that effective teaching 
indei)erident of learne/^ characteristics or instructional objectives ^ 
could be defined in terms of only four competencies • The taxonomy of 
teacher competencies specified by Moore as being both necessarji^^ancl . 
sufficient tor effective instruction* was:' • --^ 
^ ' First, a teacher must demonstrate, with a high degree 

i ■ " . , ' ■ ■ ■ 

• ■ V 

of consistency,- the ability. to bring his own teaching 

behaviot under control in 4 wide range of instructional 

conditions as opposed to coming under the control of . 

, ^ the learner'^s behavior^. For example, the teacher must 

• " , . ' ' «■ ■ 

nbt jalldy thb bright, personable student to dominate his • 

attention at the expense of the less gifted^ students. 

Bringing teacher behavior under control. i;s necessary 

because it establishes the upper limit of the teacher's v 

ability to ^observe relevant learner behavror as a basis 

for diagnosis. Second, a teacher must be able to generate 

and test productive* instructional hypotheses with respect 



to both individual and group attending problems as opposed^ r 

'to relying on a limited set of instructional $trategies^ 

^For example, the teacher must be able to observe ^nd^ / 

explain the nature of the'ltearner behavior being reinforced 

and the source of the probable reinforcer if more desirable 

substitute behaviors arS to be stimulated and reinforced. 

• ' ■ . , V . . ■ ■ . 

•Third, a, teacher must be -able to generate and test jproductive 

* . ' C ^ ^ * * . ' • 

ins tftictionar hypotheses with respect to effective - \ 

' . * \ - • ■ , ' • 

. instructional'.jpresentation systems appropriate for the 

> needs of individual learners. Fourth, a teacher must bl 

able to iden.tify Jnd postulate solutioij^ fpr problems of 

.classroom organization as they relate to .maximizing his 

effectiveness and efficiency in the classroom. For example, 

if one-assumes that a teacher has the competencies,' - , 

necessary for generating productive' instructional hypotheses * . ^ 

related to individual learning, but is faced with thirty 

learners in;the class five days a week, wfiat^^iifernative 

managemen]t ^procedures might be considered which Would 

V maximize the probability for implementing the most effective 

instructional system? ' ^ - - 

In the^Moore experiment (1974) , the data collected were associated 
withthe first two 55mpetencies. Specifically, using volunteer inservice 
public school teachers (N = 56) who were randomly, as sifene'd to experi- \ 
mental controlled ci^ditions, they provided 'l^n c las s'' feedback for the - 
experimental group, with respect to the' first two comp^enci^, for a 
period of six to eight weeks. Observations as a basis f\r>roviding 



feedback were completed using an instrument designed by the principal 
investigator. Specifically, ttie teach^ls^rfeceived in^oin^ti concerning 
the discrepancy between the teacher's ratings of students asbBing high 
6t low in need of teacher intervention for learriing'^^ to occur 'and 
evidence of teacher intervention with thos6 students he had specified 
as requiring a greater amount of teacher intervention. It was assumed 
'that the lower the discrepancy, tl^e gre&tej/^t^e control. Further, the 
teachers received feedback associated with w^the'if t;^ey were- using a 
scientific approach to problem solving with respect f to learner attending 
behavior. ' ^ - 

, To evaluat^the project, trained evalua'^ors were used who had no 
knowledge concerning which teachers were experimental or control. The 
result^ of the comparisons of a) observed instances of learner , inatten- 
tion as the measure of effectiveness of feedback associated with 
competency II and b) frequency of teacher' intervention with students ' ^ 

classified as; high need, as a measure of competency I, resulted '^in 

■ » ' ' ■ It . ■ ■ ' 

significant differences for students of female teachers for the measure . 

of competency II , and a significant, difference for both male- and female 

teachers for the^measure' of competency I. In all cases where , significant 

differences were observed/ they favored the experimental conditions. A 

retention study was completed during the following academic year and in 

this case, all differences between the experimental control group were 

in the direction of the experimental treatment. One explanaition given 

for* t}i|?^ailurfe to obtain differences in student f)er£ormance for the, 

experimental ffiale teachers in the initial evalus^^tion of competency II 

was the 5mall-size of the sample of male teachers (E = 7 and C =' 3). 



While these data provide strong support for the general hypotheses ^ 
conceprned with the conceptual appropriateness and acceptability of 
feedback as it affects teaching behavior, a nlimber of questions remained 
unanswered. First, if the sample of males had been larger in the 
initial experiment*; w^uld significant differences in learner attention 
hav^ resulted? Second, could the positive r^sul'ts of this inve^xigation 
be replicated with a different^^pulation? Third, were the results a 
function of simply the acceptability of the feedback as opposed to the 
conceptual appropriateness of the^eedback? As pointed out earlier in 
this discussion, it is probable that valid feedback will be acceptable 
while acceptable feedback4.may or may not be valid. And fourth, if 

the major hypotheses were tested in terms of competency III, would the 

. . • 

results be confirmed? ' ^ ^ 

The purpose of the present st^dy was to investifia|;e ^i^4^»q^ 

, ;•' y ■ ; ro- 
under controlled experin/ental conditiqus. Specificall// two 'experiments 

were completed. The/ first was designed M:o replicate the eixperiment of ^ - 

Moore, et al (1974) uii^er conditions which provided a larger i>umt>er of 

male subjects. The second experiment was designed to test the rese%rph 

hypotheses under conditioris a) in which teachers received feedback 

with respect to "content" organization (instructional sequence) 

appropriate to the instructional needs of individual learners and b) 

in which greater control oyer the feedback variable was exercised. ^ 
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Method 

■ .-. -K. • •• ■ ■ 

Subjects: y 

Experiment 1: • • ' 

Thirty-six volunteer, non-perirfanently certified teachers participated 
in experiment 1. Nincitton teachers *served as members of the experimental 
group' and* 17. as control group members. Teachers were matc]ied on the 
basis of sex, level taught, ^i. e. , elementary or secondary; and number 
^ of years of experience. Twelve members of the experimental group were 

■ I 

elementary* teachers and 7 were secondary teachers; Eight teachers of 
this; group were female and 11 teachers were male. Ten of the control 
gxoup members 'were elementary^teachers and were secondary teachers; 
11 were male eind ^ were female teachers. 

. ' ^.fy^ . ' ■ ■ : 

Experiment 2: , - v-^'^f '4/ ^'^ ' 



• * 

Parttctpants in exj)eriment' 2 were 21 volunteer . non-permanent ly / 
certified teachers. Teaohers were matched on teaching level; Nine ^ 
elementary and 2 secondary teachers formed the experimental group; 8 - 
elementary and 2 secondary teachers participated in the control group. 
There were 4 mal^s and 7. females in the experimental gl>oup and 6 m^le 
and 4 female teachers in the coirtrol group. ^ - » \ 



Procedure 

. - . . / 



• Experiment 1; 



The treatment condition for experiment 1 consisted providing 
i;jxe teacher with a conceptualization for using feedback associated 
with a) t:ontrolling their own teaching behavior and b) generating and ' 
testing hypotheses associated with learner attending behavior. Further, 
Simurit'ed teaching experiences (Moore, et al., 1973) were provided as a 
means for Increasing, the pr<*bability that these conceptualizations would 
be demonstrated in'an applied situation. Conceptualization training 
sessions consisted of three hour weekly seminars for a six week peijiod. 

'.''■',«-', ' . - ■■■ ' , * ' 

Finally, the/ teachers received feedback regarding their success in 
Applying the acquired conceptualizations in their own classrooms,. -The 
classroom feedback cpnditionsincluded two one-half day sessions each 

, ■ ' ■ ■ ^ ■ , ■ 

we^k for the six week period* Project staff members conducted both the 

training sessions and provided the classroom feedback. 

■ .... - ' • > ■ I . • V 

Data were -collected I as a basis for classroom feedback, using the 

Moore teacher ol)servation system (Moore, et al., 1974). Using the *^ 

observational system, staff membejrs^ provided feedback to the teachey 

:c6ncerning his control of ^his instructional behavior' by comparing* the 

actual ''number of teacher initiated verbal interventions, for a randomly 

selected ^^dup. of ten student^, with the teachers post- class ratings of 

these students regarding the amount of interirention they required for 

learning to oc<5ur. -Aj large discrepancy between the indicated need and^ 

the- satisfaction oif that need was de*fined as a low level of ^ontrol 



^ 



and conversely a* low tjiscrepancy was defined as a higher level of control 

. ■ . ». 

" ' • ■ ' '■ ■•vS > \ ' 

Staff members emfijoafea th.e following procedures J in providing feed- 



back to a teacher regai^(^p| his ^bility to generate* and test hypotheses 
regarding learner-attending behavior. First, it was assumed that a ♦ 
problem of inattention had to be identified bef6re any meaningful feed- 
back could.be provided with respect to the competencies involved. 
Second, when at least one persistent pattern of learner inattention 
was identified, the teacher's responses to that behavior were recorded 
and classifieds If no variation was observed in the teacher's responses 
to the incidence of inattention, it was expected that this feedback to 
the teacher would increase the probability that he' would vary his 
instructional procedures when his ^ original procedure was ineffective 
in bring about change. If the teacher's responses were observed to 
vary under conditiotis where the pattern of learner inattention was 
lunchanged, the teacher was provided a list Jbf his responses, following 
'class, and asked to explain why he had varied his responses. If no 
rational explanation was given, it was assumed that the feedback, 
associated with his "l^ck of an explanation,"' would increase the 

* <• # . 

probability that the tlsdcher would increase his efforts tp develop 

•V ■ - 

theoretically based explanations as a basis for his actions. If a 
theoretical explanation was given, as judged by the staff member, 
it Was assumed tnat; questions associated with its^unproductiyeness 
would increase the probability that teachers would a) seek additional 
knowledge of the constructs necessary for generating productive 
hypotheses or b) diverge in, considering- alternative hypotheses 
associated with their original explanations. 
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Thus, the staff member raised questions which were intended to 
prpvide feedback to the teacher with respect ^o his altetnatives. 
While involved in the training, the teacher could use the ^taff member 
aS' a source of kn^ledge or as> a participant in a discussion concerning ' 
.alternative hypotheses that could be generated to fit the situation. • 
these feedback procedures were repeated throjaghout the" experimental 
period. * 

-In an attempt td control, in ^art, for the, Haw^thome effect, the 
control group was observed by the project staf£ members periodically 
during the exper|j,jjientat period using the Moore teacher evaluation 
instrument. The teachers were not given specific feedback with respect 
to their teaching behavior. Remarks were limited to general statements 
about the classroom atmosphere. 

Experiment 2: 

* . •. • ♦ 

The procedures described for experiment 1 were essentially those 
employed in experiment 2 except that the experimental teachers received 
feedback associated with their ability to generate and test instructional 
hypotheses with respect to th^ (diagnosis and remediation of individual 
learner problems associated with content organization (instructional 
sequencing). Specifically, when student's were observed to answer 
questions incorrectly the teacher's behavior was recorded with respect 
to a) did hiie-cdiiliiiue to. ask the student additional questions, b) did 
the types of questions a$ked vary, and c) did the students ultimately 
respond. correctly to the original teacher initiated question. (Note: 
The term "teacher initiated questions" includes content related 



questiens and statements which require,. a student response.), following 
the completion of the class- the teacher received feedback regarding his 
teaching behavior, in class in response to inappropriate or unacceptable 
learfier behpior/ and was asked to compatfe this behavior to his 
conceptualization of the effective, use of feedback. 

/ ^Specifically, if he astked a student a question for the purpose of 
evaluating the student's level of conceptualization of the instructional 
objective and the student responded incorrectly, the teacher, was asked 
why he (the teacher) responded to the student' rf^^ response as he did. If 
he had immediately asked another student «the same question, he was 
asked how he expected this procedure to help him diagnose the learning 
problem of the first student. Jf the teacher explained that he was 
using the question for motivational reasons, then it was assumed that 
the^questidi) was not diagnostic in nature, and the^ teacher was asked 
which questions (recorded) he used for diagnosis. If the staff member 
observed that the teacher asked additional questions of the student who 
answered incorrectly, but the questions did not vary in their complexity 
or form, -he was asked to explain why his question asking behavior -had 
not vkri^ed. If the teacher's questioning behavior varied, even though 
the learner's behavior did not change, he was asked to explain his 
.rationale for the variation. Thp decision at thi^ point on the type 
of follow-up feedback procedure to be used was based on the same 
criteria outlined in experiment 1, i.e., whether or not the teacher 
gave a rationally sound explanation for his behavior. In this 
experiment, as in experiment 1, the seminars and simulation procfeures 
provided the basis for the conceptualization of the feedback system. 
To control for the effects of type of feedback, the control group 



par.ticipated in e:(:periment 1 during the sam©' experimental period 
Thus, the experimental conditions provided^ for. the twq groups were 
identical with the' exception that the , feedback for* th4^;experimentaj^ 



group in experiment 2 was concerned with hypotheses generations 
associat'edyvith content' organization as it relatecl to individual . ' f ^ 



learner requirements and not to learner \4itteh4ing/b eb'avi or . . 
Data^oltectipniv 



■ V; to teachers during 

the"* exp|t^M^ental period wereWse^ tO\^cillect /data with respect to the 
e^f|B'<j|ivjprie^s of •t^ . exiierimeijtal^^^^^^ ^ecifically, in 

expeinlfe^t ' 1 4\as a measure^^f the%^ach^^iVs ability to control his ow 
behavidf, iffie amount ;v^oC^^^ ihteryenti^^ with hign arid low need 



" 

Students was ttpippared.iy^ a *4 or 5 on the rating scale 

■ 'X: v^--. ■■ ' ■''' .,/ 

were considered to be Kh^ii; ne^d stjudents/, those ^most needing teacher 

intervention. Students asSajpred a 0 or 1 were considered low need 

/ ■ ■■■■ • 
students, those needing little or no assistance for learning to occur. 

Teiachers with a greater degree of control were those who had a low 

discrepancy between the' indicated need of the student and the 

satisfaction of that need. 

/I 

The measure of the effectiveness of the experimental treatment in 

' ;'■ ■ 

increasing the teacher's ability to generate and test hypotheses 

. ■ i ' ' . ■ . ' ■ ■ ■ ■ 

regarding learner attending behavior was the amount of student 
ihatt^tion observed in the classroom. 'Learner attending behavior was 
used as a primary dependent variable because if was measurable Across 
all subject matter and classroom situations. Further, a high 
cor;relatioi\ between learner attention and learner performance on an 



academic task was noted in several studies (Marsh, et al., 1955; 

t ^ . * . , • • , • • • 

Lahademe, 1968; Cobb, 1972). Finally, th*e specific learner behavior 
associated with competency II was learner attending behavior. 

I^) order 'to collect reliable information regarding attending 



behayidSR jthe attending and non-attending behavior of a random sample ^ 
"^tStTOj^nts was noted^ at regularly scheduled intervals during 



7ryarf6?ial period. 



jfiS* evaluate the effects of the experimental treatment for 



experiment 2, observations were made of changes in both teacher .and 
learner b^^^3j^ipr. The ultimate measure of the effectiveness of thp 
experimen^i^^l^eatment Was Change in student behavior. As with the 
measure of '^attention an effort was made to select a valid measure of 
learner performance which could be used to compare student behav^'iM:, 
with respect to competence III, independent of grade level or 's» 
and which couJL^ be relia^Ble assessed. In this case, student's ability 
' to answer a previously missed question Was used as a measure. 

As stated previously, in both experiments there was a need for 
evidence that a problem existed, for example, leampr inattention or 
learner non-mastery "of -the instructional objectives, . in order to 
evaluate the teacher 's* effectiveness in dealing with it. 

• The measXires used , to assess changes in teacher behavior, in 
J^jjcperiment 2, included the following.' First, changes in, the responses 
of teachers to student? who incorrectly answered questions were 
observed^^. Specifically,, teachers attempting to'evaluate student 
"mastery of instructional objectives, who continued to ask the 
student questions^ when the student answered incorrectly and who 
attempted to ascertain what a student did not understand were 



17. 

classified as engaging in diagnostic traiisactioHs^ These transactions 
were observed and recorded. 

The api^ropriat^ness of. the transjtCtions was also judged and 
recorded by the staff members. F<ir example, if the teacher's original 
question required a student,^ apply defining criteria in deciding 

whether an instance wa^ positive or negative instance of a concept ; 

y ■ . ' ■ - / ^ 

and the student iui^ered incorrectly, appropriate jliagnostic questions 

might have included: a) did the student know the defining criteria 

and/or bl did.he have a referent, i.e., a knowledge base, for one or 

mbire of^ithe defining attributes. In this case, the teacher had moved 

froms a higher order ipitial question to lower level questions and thus 

thfe '^sequente was , appropriate. ... - 

The procedure fpf collecting data, for purj^Oseslof evaluation, 

was for staff members to observe, at the eitd of the experimental 'period, 

a raijdomly selected group of ten students of experiments^ and "control 

teachers fof%ne 45-minute period. Teachers were unaware of which 

students constituted the sample until after the observation had been . 



completed. On]^ ten students were observed^:$ij}ce prior experiences ^ 
had indicated that attempting to collect data, of t:he typ^e described 
previously, on the entire class decreased scorer reldability. Inter- 
scorer reliability, determined prior to the posttest evaluation, 
vran^ed from .88 to .92. These observation proceduqres were the same 
for both experimental and control^ teachers. 



2 



^in an effort to replicate ihe'iorig term retention^ results reported in 
the 'Moore study (1974), the procedures reported here are being utilised 
to collect data on the same population during the 1974-75 academic year. 



19 



. > ^ 18 
Results 

Experiment 1: <. . 

An unweighted means analysis of variance was completed to deter- 
mine Whether providing conceptually appropriate feedback associated 
with valid teacher competencies wjj^s effective in increasing the 
teacher's ability to bring his own teaching behavior uhdler control, " 
For this analysis the teachers were stratified on sex, students were 

y \ • V- I. , 

stratified- on need and the teachers were compared in terms of the 
^ount of attention given to students classified as being high. or 
low in need of teacher intervention. The interact^omof the need of 
student and experimental treatment was the comparison of primary 
interact la this an^ysis. The results qf the analysis are presented 
in Table 1. 



Insert Table V about here 



As can be observed in Table 1, the interaction between need of 
Student and experimental treatment was significant (p < •01), The 
Newman-jCeuls posttest^alysis was completed to determine significant 
differences between pairs of means •« .Significant differences (p < .01) 
wete obtained. ' The mean amount of attention given ty teachers to high 
and low need students is presented in Table 2. 

Insert Table 2 about here 



As can be observed, the experimehtal teachers -gave a greater amount 

of^^attention to high need students than they did to low need students 

* «. . — • 

while this difference was not obServed between the same groups for the * 
control 'teachers; ^ 

To determine the effectiveness ofe providing feedback with respect 
to increasing the teacher's ability to generate instructional hypotheses 
associated with le^^ner attending behavior, t-tests were- completed 
comparing m^an percentage of learner inattention for male and female 
teachers in the. respective experimental and control groups. .Because „ 
of the possible existence of a ceiling effect with regard to the depen- 
dent variTa^e and the resulting difficulty in interpreting interactions, 
an analysis of variance was not used (Winer, ,1962^ p. 257), The results 
of the t-test comparisons are presented in Table 3^ ' * 

- — — ; 

Insert Table 3 about here- 



' As can be observed in Table 3, a significant difference was obtained 
for the respective comparisons. The mean^^ercentage of inattention was 
lower for both experimental males and experimental females than it was 
for *the respective control groups.^ ' 

Experiment 2: 

* ■ ■ ■ 1 

To determine the effectiveness of- providing relevant feedback 
associated with the teacher's ability to generate and test hypotheses^ 
regarding student learning problems associated with instructional 
sequencing, seyeral unweighted means analyses of variance were completed. 
One of 'thes6 analyses was completW to compare changes in student 



■ V ■-. ^ > ■ ... ; . 

behavior. Second, other analyses compared changes in teacher_ behavior. * 

. ■ ' - . ■■. v^" ■ 

Finally, an analyses was completed to ascertain whether any t* 
significant differences eiclsted between experimental and control group 
te^^ers with respect to the number of teacher initiated questions 
which were answered incorrectly by the students/ The assumption ^ undear^^ . 
lying tHis analj^sis, was that if there was a signifi(?ant difference 
l^fetween the group? in terms of the numben of quiestions answered incor- 
rectly by students, the results of other measures of the effectiveness ' 
of the experiment would be questionable.' ^ 

In this analysis, .experimental and control group teachers were 
stratified on sex, a^d compared in" terms of the number of teacher, 
initiated questions to which students responded incorrectly,"^ The 
results of this analysis are reported in Table 4. 



Insert Table 4 about' here 



These results indicate thau there were ho significant differences 

between the experimental and control^roups in terms of thcf number of 

_■>■■'■.> 
questions answered incorrectly by students. 

'"^ . ' ' ' 

One evidence of change, in. teacher behavior, compared was differences 
in teadher responses to students* incorrect answers^. Following an 
incorrect response, did teachers move to another student in their , ^ 
questioning or did< they ^attempt to diagnose the problem by aslcing the 
student additional quest^ns? The results of the statistical 
analysis used to determine^^ whether significant differences existed 



r^betj^een the treatment groups, with regard to the number of times 

' ■ ■ ' ^ . ■ • ■ ■ ■ 

i$;:^;i§|achers initiated diagnostic transactions ^With students who incorrectly 

feiift 'I ■ ' ■ ' ^ ■ ' ■ ■■ ■ 



■ ■ \ ■ A ■ 

..answered subject matter related question!^ are presented in Table .5^ 



Insert Table 5 about here 



As <fen be seen -in Table 5, a significant difference between experi-. 
mental and control group teachers, was noted. The mean number of ^ 
diagnostic sequences initiated by experimental teachers (2.91) was 
greater than the wean number itiitiated by control group teachers 10p> 

Data were also compared to determine the probable appropriateness ' 
of the transactions initiated. Fox this analysis only diagnostic 
sequences., judged to be correct, wert comared. Thus, it was possible 
to compare datk for only six (j^ l^el^;^ in the control group, 

since-«nly six'tea.cher3 engaged iit pojxeist^^^d^ sequences. Data 

were available for all eleven experimental teachers. Teachers were 
stratified on sex" and compared in terms of tHfe number of correct 
diagnostic sequenced initiated. The results are presented in Table 6. 



Insert Table 6 about here 

■■ w . — — — - — ' 

\ ' - ... • ^ 

Differences (p ^ . 10) were noted between experimental and control. 
' teachers with experimental teachers engaging in more correct diagnostic 
sequences (2.91) than control teachers (1.67). , ' 

Finally, to determine the effects of the experimental treatment on 

/ • " ,* ■ 

^learner performances, the experimental and cdntrol teachers, stratified 
on sex, were compared in terms of the number of times* students correctly 
aifisv/ered previously missed questions. The .results are presented in Table 7, 



I 



insert Table 7 about here 



./The results indicate that there m^sls a difference (p < .01) as a 
func^on of the experimental treatirient. Students of experimental 
teachers correctly answered previously missed questions more often 
(x '^ 2.27) than did students of. control teachers (3c = .60). 



uss/^ic 
/he 



Discussion; j 

. . •■ ■ 

5ata jfrpm the present studies provide support for the hypothesis 

that if teachers are given feedback,, associated with valid competencies, 

. * ^ ■ 

predicted chariges will occur in both their behavior and ultimately in the 

bel^aviar of their students. These data are observable in tables 2,^, 5, 

6 and ,7; whef ie the mean performance of teachers in the experimental grotip 

and the performance of their students on the respective measures was 

greater than the mean perfbrma^ice of the cori:esponding comparison .group; ^ 

, The fact that in experiment 1 the experimental group's performance, 
• . . . ■ . ■■ *• 

both* in terms-bf cohtroXling- their own behavior aild in terms of their 

ability to modify learner attending behavior, was greater than the 

control gtoup was consistent with the predicted finding and increases 

bQth the, confidence *which can be placed in the predictions and the 

■ •■ • " ■ , 

generalizability of^the findings. . Further, the fact that male t^eacheife' 

<^ . . . ■ . 

effectivenessi^aSi measured by learner attending behavior, "was. greater 

for experimental teachers than for pontrol teachers^ supports the hypo- 
thesis that the failure to obtain differences for t)ie comparable ^ 
-> comparfsons ih the Moore (1974) study' was a function .T;>f the small size 
of . the sample. ,y i * * 
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Not only were, the differences between ^the experimental and control 
group statistically significant, but they were of practical significance. ' 
Thes6 practical differences can be observed first . by. the fact that the 

^evel of inattention noted for classrooms of experimental teachers was 

" . /' ' ' ■ ' 

appi:oxii?ately five percent, while ^ the level of inattention iix classrooms 

af control teachers was approximately twenty-tlyree percent. .Second, 

experimental teachers interacted with high need students more than one 

and one-half times more often than control teachers (Xg =4.41 ys* " • 

2.70). ' . ^ . ' ' * - 

Third, not oAly did e^erimentaV teachers engage in^more than twi,ce 
as m?iny diagnostic, sequences (x = 2.91) than control teachers (X'= l.lO) 
but also nearly twice as many experimental teachers (N = lit) engaged in 
correct^ diagnostic sequences than did control teachers (N = 6). The 
nui&ber of correct ^ diagnostic transactions' also approached twic^* as many 
for experimental teachers (Xg = 2.91 ys. x^, = 1.67). Finally^, and most 
impiprtantly, the number of items students of experimental teasers 
answered correctly, after first answering them incorrectly,^ was almost 
four times as great as the, tontrol group (Xg ^ 2.27 vs. ST^ = .60). 

The hypothesis that the provision of feedback that was conceptually 
appropriate for all instructional conditions would be more effective in. 



bringing ^^out change in teacher behavior* than simply providing acceptable^ 
feedback was supported by the 'fact that in experiment 2. the performance of 
the experimental group was higher than the control. These fin4ings 
suggest that in addition to providing acceprta^le feedback, as suggested 
by Good and Brophy (1974), ^.t is also necessary to consider the coiicepti^al 

appropriateness of the feedbapk if one is to have a maximum effecSt on 

« «■.'■■ 

teacher be)iavj.or. « " 



w 'Summary * 

' In smmnary,^these results ^^end the gerie:^alizability of the finding, 
both in terms of popuflation and^^^^etencies, that feedback asspciated with 
valid competencies -does increase the probability of bringioig about desired 
changes ^ in both teacher. and learner behavior. Further, evidence was ob- 
tained that validn^eedback, charj&cterized by its conceptual appropriateness 
for all instructional conditions, rejsul ted in' a greater increase .im teacher 
e^PfeCftiv^ess than did^feedback which was acceptable to. teachers, but not 
completely valid for^ a given itistructional condition. 



The 'research also demonstrates a number of pdints.: 

, 1>? A CBTE program, based on competencies whiieh are conceptually approp 

,* * * 

riate for all teaching situations, can be effective in bringing about 



changes in both teacher and learner b"ehavior. ' ^ 

2) , Cpmpeten&ies, which are conceptual in nature, neiad ;to^b^ specif 
in order to measure the inter^action effects of the enabling objectives. 

3) Ey reducing the nianber of competencies to a ^small number -of con- • ■ 
ceptual competencies, i.e., -the Moore taxonomy of teacher competencies, the 
iihplementation of an effective ' teacher education program which results in , 
changes in learner bfehavior is feasible,.- 

4) , Finally,, even if, in the ideal sense, a complete conqpeten,cy based 

system is not implemented, a CBTE approach which utilizes a valid; feedback 
' ' "'^X^ ■ * ■ 

. sy6tep.dpes increase - teacher competencies as measured by changes^ii^ learner 

^ ■■ .' ■/ • ■ . ■ . 

performanpe. , . ' ^ 



.• ••».«.■ 



' Table 1 ' 

: UNWE^CTED MEANS ANALYSIS OF VARIANCE — AMOUNT OF 
^AtTEOTroN GIVEN -BY TEACHER TO HIGH' AND LOW NEED STUDENTS 



'^'-'^ w/'* > Source ■ 




df 


MS 


F 






< \ ' "'' • . Treatment (T) 




# ' 


* 3.38 


3.41 




n.s. 


> ;Need of Student 






10.11 


10'.21 






:/ V Sex of Teacher 


CST) 




9.84 


,9.94 . 




★ * 


i-V:; . ;;.T_x N X ST • 






.36 


.36 . 




n.s. 








' 6.74 


6.81 




* * 








. ' ' 3.83 


3.87 




n.s. 


::^^:^^;^'-"-vx>)\^-sT''^^ , . 






6.34 


' 6.40 




* 


f r;*^"^ V..*^ -Error:' • ' 




, 162 


.99 









p < .05 



Table 2 

■ MEAN AMOUNT OF ATTENTION GIVEN BY 
TEACHERS TO HIGH AND LOW NEED STUDENTS 





High Need Students 


Low Need Students 


Experimental , 
Control 


4.41 ° ' . 
2V7O 


1.71 

2.51 ." 



P< .01 



• ,Tab*le 3 ' ' ' 

^SUMMARY 0^ THE f -TEST ANALYSIS 
COMPARING MEAN PERCENT OF INATTENTION 





Male Teacher . ' 


Female Teacher 




' N- 


, ' a ^ t 




X /P t - 


Experimental 


. 11 


'5.157 5.001 5.588** 


8 


5.616 '4.183 3.679*'' 


Control 


- ■ 11 


2.6.225 i 1.457 


6. 


16.140^5.999 













EWC ** p< .01, 



■t 



■ Table. 4 

UNWEIGHTED MEANS ANALYSIS OF VARIANCE — NUMBER OF • 
TEACHER INITIATED QUESTIONS ANSWERED INCORRECTLY BY STUDENTS 



Source 


df 


MS 


F 


P 


Treatment (T) 

Sex of Teacher (ST) 

t X ST 


; i« 
1 
1 


.98 , ' 
-7.07 
, 7.07 


.09 ' 
.66 
.66 \ 


n . s . 
n.s. 


Error - 

1 • 


••'i7 
.1^- 









Table 5 

V . UNWEldhTED MEANS ANALYSIS OF VARIANCE — NUMBER OF TIMES TEACHERS 
Y?IfrTIATED DiAGNOSTIC SEQUENCES FOLLQJ|ING.AN INCORRECT STUDENT RESPONSE 



~ ^ 

» Source ' ^ ^ 




MS 


F 


P 




Treatment (T) '^/"^^ 
Sex of Teacher (ST) 
T X ST 


1 

1 
1 


14.42 
1.04 
.21 


8.58 
..62 
. .13 


, ** . 
h.s . 
n.s. 


J 


'Error 


17 


1.68 








** p < .01 








; 

■>■■ 








Table 6 









. UNWEIGHTED MEANS ANALYSIS OF VARIANCE — , 
NUMBER OF CORRECT DIAGNOSTIC SEQUENCES INITIATED . 



Source- 

ft 


. df ' 


MS 


F 


P 


Treatment (T) 




, • -$..51 • 


3.70* 


* 


Sex of Teacher (ST) 






.53 


n.s. 


T X jT 




.1^ 


• .11 


n.s. " 


Error 


(r; 

13 


1.49 ' 

• 

* 1 






' *p < .10 -> 


r 


28./- 







Table 7 

'unweighted means analysis of variance—- number . 
of times students cdkrectty answer "previously-missed items 



■J 



Source 


df 


' MS 


f" 


P 


Treatment (T) 


1 


13.34 


i 

9.26 


** 


Sex of Teacher (ST) 


1 


.10 


.07 


n.s. 


T X ST 

4 


1 


.06 


.04 


n.s. 


Error » ' 


17 


^ 1.44 







** p < .01 . 



r 
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